Skip to content

Conversation

@echohlne
Copy link
Contributor

@echohlne echohlne commented Oct 13, 2020

What changes were proposed in this pull request?

when bytesRead metric was negative, formatBytes in ui.js should just return 0.0 B to avoid NaN Undefined result.

Why are the changes needed?

Strengthen the parameter validataion to improve metric display on Summary Metrics of Spark Stage UI.

Does this PR introduce any user-facing change?

No

How was this patch tested?

It's a small change, just manual test.

@maropu maropu changed the title [SPARK-33132] Fix The 'Shuffle Read Size / Records' field in Stage Summary metrics was shown as 'NaN Undefined' [SPARK-33132][WEBUI] Fix The 'Shuffle Read Size / Records' field in Stage Summary metrics was shown as 'NaN Undefined' Oct 13, 2020
@maropu
Copy link
Member

maropu commented Oct 13, 2020

cc: @sarutak @gengliangwang

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-33132][WEBUI] Fix The 'Shuffle Read Size / Records' field in Stage Summary metrics was shown as 'NaN Undefined' [SPARK-33132][WEBUI] Make formatBytes return 0.0 B for negative input instead of NaN Oct 13, 2020
@dongjoon-hyun
Copy link
Member

+1, LGTM. Thank you for your first contribution, @akiyamaneko .

  • This is merged to master branch for Apache Spark 3.1.0.
  • I added you to the Apache Spark contributor group.
  • SPARK-33132 is assigned to you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants